Proportional k-interval discretization for naive-Bayes classifiers

This paper argues that two commonly-used discretization approaches, fixed k-interval discretization and entropy-based discretization have sub-optimal characteristics for naive-Bayes classification. This analysis leads to a new discretization method, Proportional k-Interval Discretization (PKID), which adjusts the number and size of discretized intervals to the number of training instances, thus seeks an appropriate trade-off between the bias and variance of the probability estimation for naive-Bayes classifiers. We justify PKID in theory, as well as test it on a wide cross-section of datasets. Our experimental results suggest that in comparison to its alternatives, PKID provides naive-Bayes classifiers competitive classification performance for smaller datasets and better classification performance for larger datasets.

Kernel-based naive bayes classifier for breast cancer prediction

The classification of breast cancer patients is of great importance in cancer diagnosis. Most classical cancer classification methods are clinical-based and have limited diagnostic ability. The recent advances in machine learning technique has made a great impact in cancer diagnosis. In this research, we develop a new algorithm: Kernel-Based Naive Bayes (KBNB) to classify breast cancer tumor based on memography data. The performance of the proposed algorithm is compared with that of classical navie bayes algorithm and kernel-based decision tree algorithm C4.5. The proposed algorithm is found to outperform in the both cases. We recommend the proposed algorithm could be used as a tool to classify the breast patient for early cancer diagnosis.

Comments on "finite-time stability theorem of stochastic nonlinear systems" [Automatica 46 (2010) 2105-2108]

In this comment, we will point out some errors existing in Chen and Jiao (2010) from definitions to the proof of the main result, where the authors discussed the finite-time stability of stochastic nonlinear systems and proved a Lyapunov theorem on the finitetime stability.

A finite-time stability theorem of stochastic nonlinear systems and stabilization designs

This paper focuses on the finite-time stability and stabilization designs of stochastic nonlinear systems. We first present and discuss a definition on the finite-time stability in probability of stochastic nonlinear systems, then we introduce a stochastic Lyapunov theorem on the finite-time stability, which has been established by Yin et al. We also employ this theorem to design a continuous state feedback controller that makes a class of stochastic nonlinear systems to be stable in finite time. An example and a simulation are given to illustrate the theoretical analysis.

A characterization theorem for t-representable n-dimensional triangular norms

n-dimensional fuzzy sets are an extension of fuzzy sets that includes interval-valued fuzzy sets and interval-valued Atanassov intuitionistic fuzzy sets. The membership values of n-dimensional fuzzy sets are n-tuples of real numbers in the unit interval [0,1], called n-dimensional intervals, ordered in increasing order. The main idea in n-dimensional fuzzy sets is to consider several uncertainty levels in the memberships degrees. Triangular norms have played an important role in fuzzy sets theory, in the narrow as in the broad sense. So it is reasonable to extend this fundamental notion for n-dimensional intervals. In interval-valued fuzzy theory, interval-valued t-norms are related with t-norms via the notion of t-representability. A characterization of t-representable interval-valued t-norms is given in term of inclusion monotonicity. In this paper we generalize the notion of t-representability for n-dimensional t-norms and provide a characterization theorem for that class of n-dimensional t-norms. © 2011 Springer-Verlag Berlin Heidelberg.

Mind change optimal learning of Bayes net structure

This paper analyzes the problem of learning the structure of a Bayes net (BN) in the theoretical framework of Gold’s learning paradigm. Bayes nets are one of the most prominent formalisms for knowledge representation and probabilistic and causal reasoning. We follow constraint-based approaches to learning Bayes net structure, where learning is based on observed conditional dependencies between variables of interest (e.g., “X is dependent on Y given any assignment to variable Z”). Applying learning criteria in this model leads to the following results. (1) The mind change complexity of identifying a Bayes net graph over variables V from dependency data is |V| 2 , the maximum number of edges. (2) There is a unique fastest mind-change optimal Bayes net learner; convergence speed is evaluated using Gold’s dominance notion of “uniformly faster convergence”. This learner conjectures a graph if it is the unique Bayes net pattern that satisfies the observed dependencies with a minimum number of edges, and outputs “no guess” otherwise. Therefore we are using standard learning criteria to define a natural and novel Bayes net learning algorithm. We investigate the complexity of computing the output of the fastest mind-change optimal learner, and show that this problem is NP-hard (assuming P = RP). To our knowledge this is the first NP-hardness result concerning the existence of a uniquely optimal Bayes net structure.

Internet traffic classification by aggregating correlated naive bayes predictions

This paper presents a novel traffic classification scheme to improve classification performance when few training data arc available. In the proposed scheme, traffic flows are described using the discretized statistical features and flow correlation information is modeled by bag-of-flow (BoF). We solve the BoF-based traffic classification in a classifier combination framework and theoretically analyze the performance benefit. Furthermore, a new BoF-based traffic classification method is proposed to aggregate the naive Bayes (NB) predictions of the correlated flows. We also present an analysis on prediction error sensitivity of the aggregation strategies. Finally, a large number of experiments are carried out on two large-scale real-world traffic datasets to evaluate the proposed scheme. The experimental results show that the proposed scheme can achieve much better classification performance than existing state-of-the-art traffic classification methods.

Labeled random finite sets and the bayes multi-target tracking filter

An analytic solution to the multi-target Bayes recursion known as the δ-Generalized Labeled Multi-Bernoulli ( δ-GLMB) filter has been recently proposed by Vo and Vo in [“Labeled Random Finite Sets and Multi-Object Conjugate Priors,” IEEE Trans. Signal Process., vol. 61, no. 13, pp. 3460-3475, 2014]. As a sequel to that paper, the present paper details efficient implementations of the δ-GLMB multi-target tracking filter. Each iteration of this filter involves an update operation and a prediction operation, both of which result in weighted sums of multi-target exponentials with intractably large number of terms. To truncate these sums, the ranked assignment and K-th shortest path algorithms are used in the update and prediction, respectively, to determine the most significant terms without exhaustively computing all of the terms. In addition, using tools derived from the same framework, such as probability hypothesis density filtering, we present inexpensive (relative to the δ-GLMB filter) look-ahead strategies to reduce the number of computations. Characterization of the L1-error in the multi-target density arising from the truncation is presented.